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METHOD AND APPARATUS FOR AUTOMATIC 
SCANNER DEFECT DETECTION 

CROSS REFERENCES TO RELATED APPLICATIONS 

[0001] None. 

5 STATEMENT REGARDING FEDERALLY SPONSORED 

RESEARCH OR DEVELOPMENT 

[0002] None. 

REFERENCE TO SEQUENTIAL LISTING, ETC, 
[0003] None. 
10 BACKGROUND 

1. Field of the Invention 

[0004] The present invention is directed to a method and apparatus for 

detecting for defects in an image forming device. More particularly, this invention is 
directed to a method and apparatus for automatically detecting defects in an image 
15 scanner. 

2. Description of the Related Art 

[0005] When scanning an image using a host-based scanner or multi- 

functional device, such as an all-in-one (AIO) scanner/copier/printer, it is often 
desirable to perform certain image processing tasks to enhance the output image as 
20 well as to remove the imperfections introduced into the image by the device. For 
example, scanned image artifacts, such as Moire patterns, can be removed using 
. image filtering techniques like de-screening filters. Smoothing filters can help soften 
the effect of noise that is injected into the scanned image during the scanning 
operation. 

25 [0006] Image content detection algorithms are often applied to detect various 

regions of the image, e.g., regions including text and photo data. This content 
detection, in turn, determines what type of image processing tasks are performed on 
those regions. Such image processing tasks play a critical role in the quality of the 
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scanned or copied image. The quality of the scanned/copied image is a major 
contributor to the perceived quality of the entire device. 

[0007] Over time, scanners often suffer from physical defects, such as 

scratches on the scanner platen glass, settled debris, such as lint and dust, smudges on 
5 the scanner lid, and various other physical defects that lead to an overall degradation 
in the scanned output quality. Not only are such defects always scanned into the 
image, but the defects themselves may cause unwanted effects on the image 
processing algorithms used to improve the scanned output or minimize the scan/copy 
time. 

10 [0008] As an illustrative example, consider how a scratch on a scanner glass 

affects operation of an autofit algorithm in a typical scanner. An autofit algorithm is 
typically applied to a scanned target image to enlarge the image to fit the page. To 
apply the autofit algorithm, the borders of the target image must be found. This is 
typically done by performing a low resolution scan across the scanner glass with the 

15 . target image on the glass and the scanner lid down. The low resolution scan detects 
non-white space, i.e., space that does not appear to be the scanner lid. The borders of 
the detected non- white space are considered to be the borders of the target image. 
Once the borders of the target image are found in this manner, a high-resolution scan 
is performed on the target image, and the scanned target image is then enlarged to fit 

20 the page. 

[0009] Performing a low resolution prescan to find the target image borders 

. first and then conducting a high resolution scan based on the detected borders saves 
memory and processing time. However, the time/memory saved and the quality of 
the output are only as good as the prescan is at finding the borders of the target image. 

25 If there is a defect, e.g., a scratch on the scanner glass, traditional auto-fit algorithms 
will detect the scratch as part of the target, since the scratch will appear as non-white 
space. The scratch will then be processed, along with the target image. Thus, more 
data than necessary will be scanned and processed, requiring a much longer overall 
scan and copy time than necessary. Also, the actual target image will not be enlarged 

30 to fit the page, as the areas included because of the defects erroneously included in the 
image will consume part of the output page. Over time, the auto-fit function may get 
slower and less accurate. 
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[0010] Physical defects also affect image filtering techniques. It is often 

desirable to sharpen edges to improve the visual contrast of the edge of an image. A 
dark piece of dust will often be detected as an edge and thus amplified by image 
filtering techniques, making it even more visible to the user. Dust may also prevent 
5 the detection of whitespace regions, thereby causing a lot of unnecessary data to be 
processed by the scanner. 

[0011] Without some means of defect detection and compensation, the user's 

experience may become more negative as the scanner ages. The means used to detect 
physical defects must not require much, if any, user interaction. Requiring such tasks 
10 often confuses the user and makes the scanner less usable. The ideal scanner would 
contain a way to intelligently detect and compensate for physical defects without the 
user's knowledge. Such smart scanning tasks would ideally improve the reliability 
and robustness of the product without affecting the usability. 

SUMMARY 

15 [0012] According to an exemplary embodiment, a method and apparatus are 

provided for automatically detecting defects in an image scanning device. A defect 
calibration scan of an image scanning area is performed. If at least one defect in at 
least one section of the image scanning area is detected a tag is generated for the 
section of the image scanning area in which the defect is detected. The defect is 

20 compensated for based on information contained within the tag. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0013] The accompanying drawings illustrate exemplary embodiments, and 

together with the description, serve to explain the exemplary principles of the 
invention. 

25 [0014] FIG. 1 A illustrates an exemplary two-dimensional map of sections of 

an image scanning area; 

[00l5] FIG. IB illustrates an exemplary defect that spans sections of an image 

scanning area; 

[0016] FIG. 2A illustrates how a target image would be conventionally 

30 detected including the defect; 
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[0017] FIG. 2B illustrates how a target image is detected according to an 

exemplary embodiment; 

[0018] FIG. 3 A illustrates an exemplary method for detecting defects in an 

image scanning area according to exemplary embodiments; 

5 [0019] FIG. 3B illustrates in detail exemplary steps of a method for detecting 

defects in an image scanning area according to an exemplary embodiment; and 

[0020] FIG. 4 illustrates an exemplary implementation of the invention. 

DETAILED DESCRIPTION 

[0021] According to an exemplary embodiment, a technique is provided for 

10 detecting defects in an image forming device, such as a scanner, automatically and 
without user intervention. The results of the detection may be stored and used for 
future analysis and defect compensation techniques. 

[0022] In an exemplary embodiment, a two-dimensional map or array may be 

used to represent sections of the image scanning area 100, e.g.,. the scanner glass, as 

15 shown in FIG. 1 A. Each section 1 10 of the image scanning area 100 is denoted by its 
grid location and is comprised of an n x m array of pixels or data elements. For 
. example, the top left section at the corner of the scan area is denoted as (1,1). Each 
section of the image scanning area is represented by a "defect tag" which is stored in a 
memory, such as a hard disk drive on a PC or non- volatile RAM (NVRAM) on a 

20 scanner controller printed circuit board (PCB). The smaller the resolution of the two- 
dimensional map, the larger the number of defect tags that exist and need to be stored. 

[0023] Each defect tag contains information representing the result of defect 

detection performed for the associated section of the image scanning area. For 
example, the defect tag may indicate that a permanent defect, such as a scratch on the 

25 scanner glass, has been detected in a section of the image scanning area. 

. Alternatively, the tag may indicate that a potential defect has been detected in a 
section of the image scanning area but that the defect may not be permanent. Other 
pieces of information may be stored in the tag as well. The goal is to be able to 
quickly identify problematic regions of the image scanning area so that image 

30 processing tasks can adjust for the defect. In general assuming that a white reference 



4 



ATTORNEY DOCKET NO. 2003.0270.02 

plane or background is being used in the scanner, sections of the image scanning area 
not containing a defect are comprised of white space. 

[0024] Tagging image scanning area sections as having defects may be useful 

in specialty modes, such as auto fit, clone, and poster. These specialty modes utilize a 
5 pre-scan to find the image borders (top, bottom, left, and right). Defects, such as 
scratches, may cause these operations to fail. 

[0025] The auto-fit function, also known as fit-to-page, finds the image 

borders and then upscales the image to fit the entire output page. If the borders are 
incorrectly found, the resulting image will not fit the entire page, and the operation 
10 will have failed. 

[0026] In the clone mode, the target image is found, scaled, and repeated on a 

page multiple times. For example, if the target image is 8x10" and a selection is made 
to clone the image four times, the image will be downscaled to fit 25% of the output 
page and repeated four times on that page. Correctly finding the image borders is 
1 5 important in this mode, just" as in the auto-fit mode. 

[0027] In the poster mode, the target image borders are found, and the target 

image is upscaled to fit over multiple pages, like pieces of a poster. This operation is 
similar to autofit except that this operation fits the target image to multiple pages. 
Finding the target image borders is important in this mode, as in the auto-fit and clone 
20 modes. 

[0028] Defects will cause the task of finding the image borders in any of these 

specialty modes to fail. According to an exemplary embodiment, these specialty 
modes may be handled by reading the stored defect tags for each scanned region 
during the image border finding task and ignoring areas with defects to prevent errors 
25 in the operation. 

[0029] For example, assume a scratch 120 is located in the bottom left hand 

corner of the scanner glass 100 spanning blocks 130 and 132 at coordinates (11,2) 
and (12, 2), as shown in FIG. IB. If a target image 140 is placed on the opposite 
comer, and an auto-fit algorithm is used to scan the target image 130, the auto-fit 
30 algorithm will detect that the image stretches from coordinates (12, 2) to (1, 10), 
roughly 82% of the total image scanning area (auto-fit usually finds the square 
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margins of the entire target image; thus for this example, it would find the image to be 
from the bottom left comer to the top right comer). Drawing the largest rectangle 
around the detected target, the target image region data would be detected from 
coordinates (12, 2) to (1, 10) as shown in FIG. 2 A within rectangle 210. Thus, the 
5 actual target image 130 will only be scaled up a minimal amount and will not be close 
to the full size of the output page after auto-fit is performed. 

[0030] However, if the two sections 130, 132 containing the scratch 120, (1 1, 

2) and (12,2) are represented by defect tags which indicate that a defect is present 
within those sections (as indicated by the shaded box 250 in FIG. 2B), then the auto- 

10 fit algorithm can be modified to take the tags into consideration and ignore such 

sections of the image scanning area 100. Using the defect tags, auto-fit would then 
detect the target image to be from (5, 4) to (10, 1), roughly 15% of the total scan area, 
as shown in FIG. 2B in rectangle 240. The target image 140 may be enlarged to fit 
the page, which is the intended purpose of the auto-fit function. Processing 15% of 

15 the image scanning area using this technique will take substantially less time than 
processing 82% of the scan area, thus using the defect tags will also save on the total 
copy time. Thus, according to an exemplary embodiment, tagging scan areas as 
having a defect can be used by auto-fit and white space detection to reduce scan time 
and better detect the actual image content. This will result in correct operation thus 

20 making the product operation adaptable to defects it incurs over time. 

[0031] Another application of defect tagging can be reducing the effect of the 

defect when the target image lies on top of the defect itself, i.e., when the section of 
the image scanning area having a defect is included in a target image region. For 
example, if an area is known to contain a defect, such as dust or a scratch, then image 

25 filtering algorithms can use this information to avoid sharpening such areas to prevent 
amplifying the problem. Smoothing algorithms, such as a median filter, may be 

. applied on such areas to reduce the visual affect of the defect itself. 

[0032] If a section of the image scanning area is tagged as having a defect, 

then recursive analysis may also be performed on that section to characterize the 
30 nature of the defect itself. This information can also be stored as part of the defect 
tag. 
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[0033] For example, assume that sections 130, 132 at coordinates (11,2) and 

(12, 2) are tagged to be permanent defects. These sections may then be analyzed in 
finer resolution to determine the nature of the defect, e.g., to determine whether the 
defect is light or dark, to determine how much of that section of the image scanning 
5 area is affected by the defect, etc. Once the defect is characterized, noise rejection 
techniques may be applied to reject the defect and use the surrounding pixel 
information to fill in the rejected space. Thus, the defect may be automatically 
removed from the scanned output image. 

[0034] According to an exemplary embodiment, defect detection may be 

10 automatically performed during a defect calibration prescan, when a target is not 

being scanned. The least likely time for a target image to be placed on the scanner 

glass is at power-up of the scanner. Thus, according to one embodiment, a quick, low 
. resolution defect calibration scan of the scanner lid may be performed at power-up as 

part of normal calibration. The defect calibration may also be performed at other 
15 times, e.g., periodically or upon request by a user. 

[0035] The defect calibration scan may be performed automatically at various 

times or may be activated in response to data indicating potential defects. For 
example, if a substantial amount of data is detected using auto-fit some number of 
times, indicating that auto-fit is failing because of defects on the scanner glass or lid, 
20 the defect calibration scan may be initiated automatically 

[0036] Since the defect calibration scan is low-resolution, the data from the 

data from the defect calibration scan may be quickly analyzed without greatly 
impacting the overall normal scan time. 

[0037] The data collected from the defect calibration scan may first be 

25 analyzed to determine if the scanner lid is down and if there is a target present. This 
' determination may be made by determining the content of the scanned data. For 
example, if mostly white space is detected in the scanned data, then there is a high 
probability that just the lid is being scanned. If the defect calibration scan data 
indicates that the lid is up or that a target present, then the defect analysis may be 
30 stopped. If the scanned data indicates that a target is in a particular section of the 
image scanning area, then the rest of the scan area may be analyzed for defects. 
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[0038] In one embodiment, if non-white space is detected (if the scanner lid is 

white as it traditionally is) in sections of the image scanning area during the defect 
calibration scanj then the associated sections are tagged as a potential defect. If, after 
some number of defect calibration scans, a section remains tagged as having a 
5 potential defect, then that section may become tagged as containing a permanent 
defect, such as a scratch. If a section is tagged as having a potential defect section 
once, but then a defect is not detected for that section subsequently, then that section 
may be cleared as a defect section and the defect may be assumed to be floating 
debris, such as dust or lint. 

10 [0039] Other characteristics of the section may be stored with the tag, such as 

the number of color, gray, and black pixels contained in the defect region. This 
information may be used by other image processing tasks to compensate for the 
defect. 

[0040] By performing periodic, automatic defect calibration scans arid storing 

15 the results, the defect detection becomes adaptive to help extend the reliability of the 
product without requiring user intervention. Of course, defect calibration scans may 
also be initiated responsive to a user action, e.g., by prompting a user to scan the lid 
for calibration purposes. 

[0041] FIG. 3 A shows an exemplary method for performing basic defect 

20 detection for a scanner. A quick defect calibration "pre-scan" is performed at step 
3 100, the pre-scan data is sectionalized and examined for defects in the image 
scanning area at step 3200, and tags are generated for each of the sections containing 
a detected defect at step 3300. Based on the tags, the defects may be compensated for 
in the scanned image. 

25 [0042] FIG. 3B shows in more detail exemplary steps in a method for 

automatic defect detection. Upon occurrence of an event, such as power-up 3000a, a 
user request 3000b, or some other event, such as a periodic timer 3000c, the defect 
detection task is triggered. A quick scan is performed at step 3105. According to one 
embodiment, the scanned data is analyzed at step 3 1 10 to determine if the scanner lid 

30 was detected as being down. If the scanner lid was not detected as being down at step 
3 1 20, the defect detection stops. 
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[0043] If the scanner lid was detected as being down and no target was 

detected on the scanner glass, then each section of the imaging area is analyzed for 
non- white areas at step 3205. 

[0044] For sections that are determined to have non-white areas, tags are 

5 . created and loaded, updated, and stored at steps 3305, 3310, and 3315, respectively. 
Once the tag is stored for a section at step 3315 or if a section is determined to have 
no non- white areas at step 3210, the analysis moves to the next section at step 3320 
until the last section is reached at step 3325. Then the analysis is completed at step 
■ . 3330. Once all sections have been analyzed, the task "sleeps" until the occurrence of 
10 another event trigger. 

[0045] Although not illustrated, additional steps may be taken to recursively 

sub-divide the sections tagged as having a defect and determine exactly where and/or 
what the defect is. The information stored in the tag may also be read after a section 
is determined to be non-white to determine, e.g., whether the defect has been detected 
15 before (indicating a permanent defect, such as a scratch), or if the defect is new 

(indicating a temporary defect such as dust). If the section was determined to only 
contain white areas, the tag associated with the section may be loaded, and any defect 
information contained within the tag may be cleared. 

[0046] It should be appreciated that other events besides the ones listed in 

20 FIG. 3B may trigger the defect detection task. The three triggering events listed are 
just examples. Also, depending on triggering event, the flow of steps may change. 
For example, if the user requested that the defect detection task be run, then if the 
scanner lid is not detected at step 3120, the user may be prompted to close the scanner 
lid. 

25 [0047] FIG. 4 illustrates an exemplary apparatus and system for automatic 

defection detection according to an exemplary embodiment. In FIG. 4, defect 
detection/compensation is applied in a scanner 400 having traditional scanner 
components. The scanner may also include an ASIC 425 that receives scanned data 
and includes memory and a processor for performing the tasks of defect detection and 

30 analysis, tag generation and storing, and compensation. The scanner may be a 

standalone scanner, be part of a multifunction device such as, for example, a printer, 
scanner, copier, or may be connected to a host computer 450 from which instructions 
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may be sent to the scanner to perform a scan. ASIC 425 may operate independently 
from the host computer 450 to perform defect detection, tag generation and storing, 
and compensation. Alternatively, the host computer may obtain scanned data, e.g., 
prescan data, from the scanner 400 via a software driver and then perform the tasks of 
5 defect detection, tag generation and storage, and compensation. As another 

alternative, the ASIC and the host computer may share the tasks of defect detection, 
tag generation and storage, and compensation. 

[0048] According to exemplary embodiments, the automatic defect detection 

and compensation technique is adaptive and improves the reliability of output quality 

10 and performance of the image forming device, despite the introduction of defects into 
the device over time. By automating a quick defect calibration scan, defects may be 
detected and associated defect tags can be stored for the affected region. The storage 
of such information may be used by subsequent image processing techniques to 
compensate for the defects. Information may be stored in the associated tags to make . 

15 the compensation routines more robust and the detection more adaptive. 

[0049] Other aspects of the invention may be found from the attached 

drawinjgs and other related materials such as a detailed review of the various functions 
offered by the present invention, which are integral parts of this disclosure. 
Moreover, other embodiments of the invention will be apparent to those skilled in the 
20 art from consideration of the specification and practice of the invention disclosed 

herein. It is intended that the specification and examples be considered as exemplary 
only. 

WHAT IS CLAIMED IS: 

1 1 . A method for automatically detecting defects in an image scanning device, 

2 comprising the steps of: 

3 performing a defect calibration scan of an image scanning area; 

4 analyzing data produced from the defect calibration scan to detect at least one 

5 defect in at least one section of the image scanning area; and 

6 generating a tag for each section of the image scanning area having a detected 

7 defect. 
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